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Abstract 

The Weight/Performance Management Survey Man- 
ual provides procedures for a management audit of 
NASA Apollo Program contractor activities, assesses 
performance towards objectives, evaluates effective- 
ness of the management system, and where weaknesses 
exist, it provides a tool for determining corrective ac- 
tion. This amplifies Mass Properties Standard NASA 
SP-6004, June 1965. 
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INTRODUCTION 


To assure effective planning, optimization, and control of the Apollo Space Vehicle weight 
and performance management program, it is imperative that each center, contractor, and 
sub -contractor develop and maintain efficient mass properties control systems. Confi- 
dence in the effectiveness of the weight and performance management program can only be 
assured by the qualitative evaluation of the adequacy of the established mass properties 
systems. Such evaluations, to be practical and worthwhile, must include the necessary 
elements of planning, conducting, reporting, and follow-up . 

This manual is presented as an aid in meeting the requirements of those NASA managers 
concerned with functions related to mass properties control, and as such provides guid- 
ance, procedures, instructions, and work sheets for surveillance as well as more thor- 
ough periodic management surveys . 

This manual was prepared by the Performance Analysis and Control Office (Code MAP-2) 
of the Apollo Program Office, NASA, Washington, D.C. 

The techniques developed herein can readily be converted to meet evaluation requirements 
in other areas. Electrical power management, thermal control and vibration, shock, and 
acoustics are typical examples . 


WHY THIS EFFORT? 

In the interest of attaining true program mass properties control; this formal management 
survey provides an audit of NASA and contractor activities, assesses performance toward 
objectives, evaluates effectiveness of relationship between participating organizations, and 
where problems exist, provides a tool for determining corrective action. 

Prior to assessing a mass properties control system it is necessary to specify: 

Objectives 

The results of the management survey must provide a full measure of current and pro- 
jected status, identify weaknesses, and establish remedial actions. 

Policies 

Basic ground rules or guides must provide assurance that desired goals and objectives 
will be attained. 

Plans 


It is necessary to transform the objectives and policies into a systematic working docu- 
ment which delineates a realistic schedule of survey events, identifies areas of concern, 
and establishes a technical and administrative approach. 

Standards of Measurable Performance 


The results of the survey must be expressed in readily recognizable quantitative terms, 
preferably a proficiency rating (PR) . 




UTILIZING THE RESULTS 


The survey will provide results which define the administrative as well as the engineering 
deficiencies. Accordingly, cognizant NASA managers will obtain valuable insight into 
existing and probable contractor weaknesses; and will be in a better position to take 
actions essential to the solution of weight and performance control problems. 

The ultimate worth of the obtained results will be a direct function of the effort extended 
by the survey team in planning and executing its assigned task. 


OBJECTIVES 

Six areas of concern must be investigated to ascertain mass property control system 
status, weaknesses, and desired remedial actions. They are: 

a. Planning: Recognition and proper phasing of each and every action necessary to 
attain mass properties objectives. 

b. Communications: Policies and procedures (instructions, work orders, informa- 
tion flow system, etc.) defining authorities and responsibilities sufficiently to direct, 
control, conduct, and administer the mass properties control system. 

c. Disciplines: Adequacy of managerial discipline and organization in requiring 
compliance with plans, policies, and procedures necessary to attain mass properties 
control objectives . 

d. Training and Education: Sufficiency of details of who, why, what, when, where, 
and how of mass property control system provided to responsible personnel at all levels. 

e. Judgments: Soundness, prudence, and practicality of decisions made in carrying 
out the mass property control system plans, policies, procedures, information flow, and 
technical aspects. 

f . Technical knowledge and ability to perform engineering functions, including mass 
property analyses and evaluations of vehicle performance, in compliance with specifica- 
tions and standards . 

These areas of concern can be measured quantitatively through an analysis, based on a 
series of evaluation questions, resulting in an overall "Proficiency Rating." This is 
covered in detail in the "Standards of Measurable Performance" section. 


POLICIES 

Technical Approach 

The evaluations will be accomplished by a team of responsible representatives of cogni- 
zant center engineering groups, and supported by the MSF/ Apollo Program Office in 
the role of amicus curiae. The evaluation consists of nine steps, starting with the 
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selection of the team, and ending with the final report containing the results of all action 
'items. 

Team Function 


Each team member will be assigned primary and secondary areas of responsibility. He 
will, at the conclusion of the evaluation, prepare an informal report for the chairman, 
covering his primary area of responsibility, and critique the report covering his sec- 
ondary area of responsibility. The final report is prepared by the chairman, and 
critiqued by the team members . The chairman is also responsible for scheduling the 
events and meetings required for the evaluation, and for making necessary arrangements 
with the contractor. 

Prerequisites 

The evaluation of any area of a contract is a task which must, once the decision is made 
to proceed, be accomplished with a minimum perturbation to the contractors effort. 

The evaluation team, to properly discharge its responsibilities, must be fully and com- 
pletely prepared for the task; therefore, the prerequisites are an essential part of the 
evaluation. How the evaluation goes, and how successful the team is, will depend entirely 
on how well they are prepared. 

Modus Qperandi 

The evaluation shall be conducted in nine basic steps, starting with the selection of the 
team members and ending with the submittal of the final report. Therefore, adherence to 
the basic procedures is strongly recommended for consistency and assistance in the re- 
quired follow-on actions . 

The prerequisites, agenda, and work sheets presented should be critiqued and amended 
for applicability to the particular contract being evaluated. The relative importance 
of the six areas (noted under objectives) should be established and noted on the work 
sheets of Table I prior to the evaluation. 

End Item Reports 

An objective summary of the evaluation, emphasizing the areas of concern, will be pre- 
pared for management immediately following the evaluation. This summary will, in 
addition to reviewing the actual evaluation, contain a complete listing of all incomplete 
action items, with a schedule for resolution. A complete report will follow the summary 
after all action items are complete, and will contain additional recommendations and a 
follow-up schedule. 

Follow-up 

Follow-up evaluations should be conducted by the same team, whenever possible, to de- 
termine the effectiveness of the recommendations and action items, and to provide con- 
tinuous surveillance of the program . 
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PLANS 


Team Selection (step one) 


It is desirable to utilize a small group of competent individuals with the team chairman 
from the cognizant project or chief engineer's office. Suggested areas of team specialist 
representation and responsibility are: 


A. Weight Control 

B. Mass Measurement (facilities, propellant loading, etc.) 

C . Systems Engineering 

D. Contracts 

E. Project Office 
Initial Meeting (step two) 

An initial meeting of the team is required to: 

A. Explain the objectives of the evaluation, and the responsibilities of team mem- 
bers. 

B. Make assignments of primary and secondary areas of responsibility. 

C . Establish a schedule of events for the evaluation. (This will provide each team 
member with the relationship of his inputs to those of the other team members .) 

D. Prepare a preliminary agenda for the meeting with the contractor. 

Team Actions (step three) 

In accordance with the developed schedule it is necessary to assure that: (1) sufficient 
background data will be available for the team members to prepare for the visit to the 
contractor's facility, and (2) the contractor will have sufficient time to respond to the 
notice of evaluation. To accomplish these objectives adequately, the following items 
should be considered: 

I. The chairman informs the contractor, through official channels, of the evaluation, 
including objectives and expected cooperation. Notification will include: 

A. Definite date of team visit to contractor's facility in accordance with the devel- 
oped schedule. 

B. A preliminary agenda, with a request for additional items that the contractor 
considers relevant to such an evaluation, and schedule for submittal. 

II. The chairman prepares, and distributes to the team members, a preliminary outline 
of the final report . See Table III for sample outline . 
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III. Team members compile: 


A. Background data in support of the survey agenda and final report. 

1. CONTRACT REQUIREMENTS — Exact requirements imposed on the contractor 
and delineation of information of informal or working agreements; control requirements 
imposed on the contractor (e.g.,NASA SP-6004, Mass Properties Standard, or equivalent); 
submittal requirements and specification requirements . 

2. RESPONSE TO REQUIREMENTS 

a. Evaluation of submittals (Should include completeness, validity, and 
timeliness of submitted data.) 

b . Supplemental data— Does the contractor respond to requests for supple- 
mental data? 

3. COMPARATIVE DATA 

a. Trend relationship between contractor— submitted data and contractual 
requirements . 

b. Compatibility of measured data with calculated and estimated data. 

4. PROBLEM AREAS 

a. Current, past, and possible future problems based on center/contractor 
relationships to date . 

b . Remedial actions and their effectiveness in solution of prior problems . 

B . Detail outline of informal report of assigned area of responsibility in accordance 
with the preliminary final report outline, noted in II above . 

IV. Agenda 

The chairman prepares final agenda, with supporting checklist, considering con- 
tractor’s response to request for additional items. 

A . Purpose 

1. The agenda shall cover the steps which are necessary to obtain and sub- 
stantiate the answers to questions covering all classifications in the Qualitative Evaluation 
Sheets . 

B . Recommended Basic Agenda 

1. SESSION I 

a. Attendees 

(1) NASA personnel 

(2) Contractor personnel 


5 



b. Purpose 


(1) Chairman will discuss agenda items, purpose of evaluation, and 
anticipated results . 

(2) Contractor personnel will present to NASA the material which they 
have prepared to assist in the survey. 

2. SESSION n 

a. Attendees 

(1) Session II will consist of separate simultaneous sessions of NASA 
personnel responsible for each Classification, meeting with contractor personnel cognizant 
in each Classification. 

b. Purpose 

(1) Discuss in detail each Classification of Weight/Performance Manage- 
ment. Obtain answers to all questions in Qualitative Evaluation Sheet for each Classifica- 
tion. 


(2) Examine substantiating evidence for answers to questions, where 
applicable, (i.e., records of deliveries and documentation submittals, test equipment 
calibration records, substantiation of vendor and subcontractor weight/performance 
management sufficiency, etc .) 

3. SESSION m 

a. Attendees 

(1) All personnel present at Session I. 

(2) Any additional personnel as determined to be necessary to meet the 
purpose of Session III. 

b. Purpose 

(1) Clear up any questions remaining unanswered by Session II, par- 
ticularly in areas involving interfaces among Classifications. (May include additional 
presentations, therefore a time allocation should be made to cover this contingency.) 

(2) Resolve any conflicts between question answers and substantiating 

evidence . 

(3) Assign Action Items to contractor by NASA where necessary to sub- 
stantiate or clear up any items as required to meet all requirements of the survey. 

(4) Summation of survey activities . 
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V. Final agenda is provided to team members and contractor. 

Team Meeting (step four) 

A. Review by the chairman of the objectives, responsibilities, and assignments. 

B. Review the agenda, and make any adjustments required as a result of investiga- 
tions made in the development of the background data, and contractors response to 
notification of evaluation . 

C . Background data distributed to team, accompanied by any discussion necessary 
for clarity and understanding by the team members . 

Initial Meeting with Contractor (step five) 

A. Chairman discusses purpose and scope of survey (Session I of agenda). 

B. The contractor makes his presentation in accordance with the requirements of 
Session I of the agenda. 

C. Team specialists hold "depth interviews” (Session II of agenda) with contractor 
representatives . 

Team Meeting (step six —Held immediately following Session II of agenda.) 

A. Review of findings, with a determination of: 

1. Items not covered. 

2 . Items covered, but not to the satisfaction of team specialists . 

3. New items, resulting from initial meeting with contractor. 

B . Notification to contractor of: 

1. Additional presentations required. 

2. "Depth interviews” with specific individuals or groups required. 

C . Identification of all action items with assignment of responsibility for resolution 
and/or recommendations. 

Final Meeting with Contractor (step seven) 

A. Additional presentations and/or "depth interviews" with cognizant contractor 
representatives. (First item of Session III of agenda.) 

B. Assignment of action items, includes identification and scope of contractor or 
customer responsibility, and determination of schedule for a resolution or recommendation. 

Team Actions (step eight— upon return to NASA installation) 

A. Resolution and/or recommendation of action items assigned. 


7 



B. Draft of assigned informal report. 

C . Critique draft of secondary assignment. 

D. Submit any recommendations and/or comments relative to the evaluation. 
Completion of Assignment (step nine) 

A. Chairman completes and edits final draft of report and summary of open items . 

B. Report submitted to distribution. 


STANDARDS OF MEASURABLE PERFORMANCE 
The Proficiency Rating 

Placing a "Proficiency Rating" (PR) upon an organization and its mass property control 
system requires a quantitative approach. To do this a set of 99 basic evaluation questions, 
Table I, have been assembled. These questions when answered and rated, result in both 
an administrative and an engineering PR rating. The administrative PR rating provides a 
measure of the contractor’s planning, communications, discipline, training and education, 
judgment, and technical know-how. The engineering PR rating provides a measure of 
engineering management with respect to: 

1. Preparedness and Attitudes 

2. Formulation of Requirements 

3. Formulation of the Mass Properties Control System 

4. Mass Properties Analysis 

5. Design Monitoring 

6. Subcontractor and Vendor Surveillance 

7. Measured Data 

8. Mass Properties and Performance Assurance 

9. Submittals 

The results of the administrative and engineering evaluation allows the survey team to 
pinpoint weaknesses. It is through this media then, that NASA management can make 
constructive recommendations to the contractor. Additionally, the survey points out to 
NASA where contractual action should be taken to effectively resolve critical conditions. 

The Evaluation Technique 


The evaluation is relatively straight-forward in that the previously noted questions are 
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used to determine the depth and scope of the contractor's mass property control effort. 

' The survey team may augment the basic questions with leading inquiries of greater detail, 
but the ultimate goal should always be to obtain responses to the basic question. Detailed 
probing will allow the team to rate the contractor’s basic response in a more efficient 
manner. A word of caution is in order, however, since too many detail questions will 
only serve to cloud the issue. 


Hating the Answers (see Table I) 

To the right of each question there is a block similar to the one shown here . This is the 
answer rating block . 


+ 

Y 

- 

+ 

N 

- 


Since all basic questions require only a yes or no answer, the survey team’s task be- 
comes one of determining the quantitative worth of the yes or no response. This is 
accomplished by utilizing lead questions as previously noted and interpreting the answers 
quantitatively by rating them to the plus, middle, or negative side of yes (Y) or no (N). 

The survey team may circle one of the individual blocks during the course of the interview 
once the question is answered. For example: 



After the survey is completed the circled answers are rated numerically as follows: 


10 

8 

6 

4 

2 

0 

+ 

Y 

- 

+ 

N 

- 


For example, a negative yes is evaluated as six. A negative no is worth zero. The 
numerical value should be placed next to the circled block but only when the survey is 
completed. The maximum worth of any classification is ten times the number of ques- 
tions . Therefore, if there are four questions the rating could vary between zero and 
forty, and is accomplished by adding the individual question ratings. The rating given to 
each classification is entered on the Proficiency Rating Form, Table II. Summing the 
individual totals and dividing by 990 results in an overall PR rating and completes the 
quantitative rating. The higher the PR the more adequate the contractor’s mass proper- 
ties control effort. The highest or best rating is 100 percent. 

A Final Word 


The proficiency rating so obtained is regarded as a sound measure of the depth and scope 
of the contractor’s effort. However, there are times when a critical situation may exist 
and be so detrimental to project and program objectives that the proficiency rating cannot 
accentuate it adequately. For example, if a contractor is not submitting data (i.e., none 
at all) in accordance with NASA requirements, a special condition exists and warrants a 
special report which should immediately be brought to the attention of cognizant parties 
for corrective action. In essence, a contractor’s effort may be efficient and expeditious 
but NASA cannot determine this unless it receives a tangible end product, namely the re- 
quired submittals . 
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TABLE I 


Evaluation Questions 



QUALITATIVE EVALUATION NO DATE - 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE. 

RATING OFFICIAL 

Name and Title 


Classification: 1. PREPAREDNESS AND ATTITUDES 


Objective : To review the contractor’s overall responsiveness 

(These questions should be answered after the survey.) 


a. Planning 

(1) Was the contractor adequately prepared for the survey 
in accordance with the NASA agenda? 

b. Communications 

(1) Were contractor position and policy statements, and 
responses to NASA questions consistent at all manage- 
ment and engineering levels? 


d 

Y 

□ 

E 

N 

3 


+ Y - + N 


c. Disciplines 

(1) Did the contractor support the survey by expeditiously 
assuring the availability of cognizant personnel to 
answer inquiries or to acquire requested documenta- 
tion? 


E 


□ 

E 

JL 

n 


d. Training and Education 

(1) Was there an awareness at all management and engi- 
neering levels of the importance and meaning of mass 
properties control? 


E 

Y 

□ 

E 

Ljl 

□ 


e. Judgments 

(1) Were the responses to the majority of the questions 
straightforward and sound rather than evasive with 
little foundation? 


E 

Y 

E 

E 

N 

□ 


f. Technical 

(1) Was the contractor's preparation for the technical 
aspects of the survey evident in detail discussions 
and/or contractor prepared material? 


B 

Y 

n 

E 

N 

□ 
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QUALITATIVE EVALUATION NO. 

CENTER 

CONTRACT NO 

RATING OFFICIAL 


DATE. 

CONTRACTOR 

STAGE/MODULE 

Name and Title 


Classification: 2. FORMULATION OF REQUIREMENTS 

Objective : To determine the existence of requirements, 
procedures, and documentation essential to 
effective mass properties control. 

a. Planning 

(1) Are mass properties requirements traceable 

through all levels of contractor and related NASA 
documentation? (This includes contracts, 
standards, specifications, and substantiating 
reports as applicable to contractors, sub- 
contractors, vendors, and government furnished 
equipment.) 

b. Communications 

(1) Are established mass property requirements or 
subsequent revisions expeditiously transmitted 
to the cognizant engineering elements? 

c. Disciplines 

(1) Are mass property requirements and revisions 
coordinated at all applicable contractor and NASA 
management and engineering levels? 

d. Training and Education 

(1) Does the contractor have documented procedures 
and guidelines for implementing and maintaining 
an effective mass properties control program? 

e. Judgments 

(1) Are the contractor’s interpretations of documented 
requirements consistent with a governing Mass 
Properties Standard (NASA SP-6004 or equivalent)? 

f. Technical 

(1) Does the contractor have documented analyses 
and evaluations which substantiate existing 
requirements? 


H 

Y 

□ 


N 

□ 


N 


El 

Y 

I 

+ 

N 

□ 



Y 

□ 

+ 

N 

□ 


L±_ 

Y 

E 

+ 

N 

□ 


N 
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QUALITATIVE EVALUATION NO DATE. 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 


Classification: 3. FORMULATION OF THE MASS PROPERTIES CONTROL SYSTEM 


Objective : To establish the depth and scope of the plan- 

ning, organization, and control of mass prop- 
erties system. 

a. Planning 

(1) Does the contractor have a planned (i.e. , a key 
event and milestone schedule) mass properties 
control program? 

(2) Does the plan provide for studying, analyzing, 
documenting, reporting, and controlling mass 
properties? 

(3) Does the plan provide for automatic data processing 
(or other acceptable accounting procedures), 
drawing sign-offs, mass measurements, and sub- 
contractor and vendor surveillance? 

(4) Does the plan provide for the establishment and 
control of changes to requirements (i.e. , 
specification weights, center of gravity limits, 
etc.) ? 

b. Communications 

(1) Is the contractor’s mass properties group on 
distribution for all documentation pertaining 
to or affecting mass properties ? 

(2) Do key mass properties members actively 
participate in cyclic meetings of design review 
committees, change control boards, and/or 
project staff? 

(3) Does the system provide for direct (i.e. , un- 
filtered) internal mass properties status 
reporting to all functional areas, and all 
applicable management levels up to and including 
the project manager ? 

c. Disciplines 

(1) Does the project mass properties control group 
have full responsibility for the management of 




Ej 

Y 

□ 

DJ 

N 

n 
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the mass properties control program (i.e. , no split 
responsibilities with staff groups)? 

(2) Is the identity and management level of the contractor's 
mass properties control group easily determined 
from organizational charts (i.e. , no integration of 
mass property group elements with other functional 
areas) ? 

(3) Is the mass properties group adequately staffed and 
organized (i.e. , accounting, weight control and 
analysis, mass measurement, and administrative 
elements) to effectively accomplish the mass 
properties control program? 

(4) Does the manager of the mass properties group have 
access to top management to make recommendations 
and obtain decisions on mass property problems ? 


E 

Y 

p 

E 

N 

p 


- 

Y 

rz 

E 

E 



E 

Y 

□ 

H 

N 

p 


d. Training and Education 

(1) Does the mass properties control group actively 
(i.e., through posters, charts, brochures, handbooks, 
and/or classroom instructions) provide the who, what, 
why, and methods of weight control to functional 
design elements as well as the appropriate project 
management elements ? 

(2) Is the training and education program to be maintained 
on a continuous basis throughout the lifetime of the 
project ? 


* 


□ 

S 

N 

P 


E 

E 

n 

E 

N 

□ 


e. Judgments 

(1) Are the decisions which involve mass properties 
made within the framework of performance, cost, 
schedule, and reliability trade-off effects? 

(A positive answer should be supported by actual 
documentation. ) 

(2) Are management decisions affecting mass properties 
agreed to by cognizant mass property personnel? 

f. Technical 

(1) Is the contractor's mass properties control program 
effective through the conceptual, definition, design, 
test, and checkout phases and in compliance with 
NASA approved standards and/or specifications? 

(2) Does the mass properties group have cognizance over 
(or access to) weight and performance trade-off 
assessments, and corresponding mass property 
evaluations ? 


N 


N 


N 


N 












QUALITATIVE EVALUATION NO DATE 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 


Classification: 4. MASS PROPERTIES ANALYSIS 


Objective : To determine the extent and adequacy of contractor 
performed design optimization, trade-off and 
requirement analyses as applicable to mass 
properties. 


a. Planning 

(1) Is there an overall project development plan which 
provides for continuous design assessments to 
optimize weight and performance (i.e. , are hard- 
ware problems under continuous assessment or 
are they solved only when they become critical) ? 


N 


b. Communications 

(1) Does the mass properties group supply analytical 
inputs to design review, change control, and 
project staff meetings? 

(2) Is the mass properties group sufficiently informed 
of the results of such meetings to implement 
effective follow-up actions? 


+ Y - + N 


+ Y - + N 


c. Disciplines 

(1) Does the mass properties group include a technical 
analysis element (i.e. , weight control, performance, 
and mass measurement analyses)? 


+ 

Ml 

n 

EJ 

N - 


d. Training and Education 

(1) Are the weight control, performance, mass 
measurement analysis techniques, and result 
matrices documented and readily understood 
by the laymen? 

(2) Have the developed techniques and typical results 
been provided to cognizant NASA elements for 
review and comment? 

e. Judgments 

(1) Have management and design decisions involving 
mass properties been based on technical 




□ 

r+i 

1 N 

□ 


N 


N 
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( 2 ) 


assessments (within the purview of cost, schedule, 
performance, and reliability) ? 

Is the time lag from the decision date to actual 
implementation reasonable (i.e. , not greater than 
two working days) ? 


H 

Y 

□ 

E 

N 

n 


f. Technical 

(1) Have design constraint ground rules and quantitative 
values been established in sufficient depth to allow 
specification mass properties criteria to be defined 
and evaluated? 

(2) Have analyses of mass properties uncertainties been 
accomplished for use in overall system error 
analyses, to verify nominal values analytically, and 

to assist in identifying elements of hardware requiring 
test verification (a positive answer requires tangible 
evidence of such studies) ? 

(3) Do the contractor’s mass properties assessments 
provide for the early detection of potential weaknesses 
and system interface incompatibilities through 
systematic trend evaluations of system growth and 
performance changes? 

(4) Are the performed assessments (i.e. , in reference 
to established specification, contract end item, 
and/or scope change quantitative definitions) 
compatible with the results of NASA technical 
assessments? 


+ 


N 


+ 


N 


E 

v 

n 

E 

N 

□ 


E 

E 

□ 

0 

N 

□ 


17 








QUALITATIVE EVALUATION NO._ 


DATE. 


CENTER, 


. CONTRACTOR . 


CONTRACT NO. 


.STAGE/MODULE. 


RATING OFFICIAL. 


Name and Title 


Classification: 5. DESIGN MONITORING 

Objective : To establish the depth and scope of the contractors 
mass properties design monitoring activity. 


a. 


b. 


c. 


(1) Are all functional systems continuously monitored j 


3 

□ 


N 

a 

(i.e. , on a scheduled basis) for mass property 
changes ? 

(2) Are functional system design reviews held on a i 

regular basis? ' 

(3) Has the mass properties control group prepared a 

status of each specification and drawing to anticipate 1 

workloads and to pinpoint gaps or items in process? 

Communications 



3 

3 

+ 

N 



+ 

rs 

- 

+ 

N 

- 


(1) Does the cognizant mass property analyst participate 

L±J 

Y 

- 

+ 

N 

□ 

in and/or receive the results of the functional system 
review? 

(2) Is the cognizant NASA element informed of problems 
brought to the fore in the review which may compro- 
mise established specifications or other contractual 
requirements? 


+ 

Y 


Pm 

N 

□ 


(3) Is the mass property control group on automatic and 

-1- 

Y 

- 

+ 

N - 

prompt distribution for all indexes, drawings, 
specifications, changes, and parts lists issued by 
the contractor's and sub-contractor's engineering 
and drafting groups? 

(4) Does it appear that the mass properties control group 
is at all times in complete communication with the 
remainder of the engineering department and drafting 
groups ? 

Disciplines 


+ 

LT 

- 

+ 

In 

a 


(1) When the mass property control group does not concur 

LZ 

LZ 


+ 

N 

□ 


with the drawing, design specification, or change, do 
they transmit their comments directly to the originating 
unit, and is subsequent communication documented 
until a satisfactory resolution of the problem is 
obtained? 
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(2) Is the mass property control group included in the 
contractors engineering sign-off procedure? 

(3) Do all drawings and changes indicate date of review, 
the reviewer, and do they include a weight block? 

(4) Does the mass properties control group monitor all 
project mass property activities (i.e. , technical, 
administrative, manufacturing, test, and field 
efforts)? 

d. Training and Education 

(1) Are the design monitoring procedures and techniques 
documented, readily understood, and available to 
personnel receiving on the job training? 

(2) Are the aforementioned procedures straightforward, 
feasible, and a true representation of the mass 
properties group 1 s design monitoring activity? 
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e. Judgments 

(1) Are the reasons advanced by the contractor in justifi- 
cation of his mode of design monitoring sound and 
practical in the overall engineering sense? 

(2) Will the contractor’s method of design monitoring 
provide results which will support sound management 
decisions ? 
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f. Technical 

(1) Are percents of estimated, calculated, and actual 
weights an integral part of the mass property control 
system ? 

(2) Is there an adequate procedure for entering weights 
into a control log after a specific item of hardware 
has been released from manufacturing ? 

(3) Is the mass property control group's accounting of 
released drawings compatible with the drawing 
release schedule? 

(4) Are standard forms, formats, and analysis procedures 
utilized in performing the design monitoring effort 
(e.g. , NASA SP-6004 or equivalent formats)? 
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QUALITATIVE EVALUATION NO DATE. 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 


Classification: 6. SUBCONTRACTOR AND VENDOR SURVEILLANCE 


Objective : To determine the effectiveness and scope of the 

mass property control program being enforced by 
the contractor on subcontractors and vendors. 


a. Planning 

(1) Does the contractor have a plan for monitoring sub- 
contractor mass property efforts? 

(2) Do the contractor’s procurement specifications, 
purchase orders and/or specification drawings clearly 
specify limiting mass property conditions which must 
be met or bettered? 

(3) Are the subcontractors (i.e. , for major items of 
hardware) contractually obligated to follow mass 
property control requirements similar to NASA SP-6004 
or its equivalent? 

b. Communications 

(1) Is the contractor’s mass properties group responsible 
for monitoring subcontractor and vendor efforts? 

(2) Is there a clearly defined procedure for assuring 
compliance with established requirements? 

(3) Do the periodic subcontractor design reviews include 
a review of the mass property control effort? 

c. Disciplines 

(1) Does the contractor’s mass properties group or its 
representative have authority (i.e. , within the limits 
of the contract) to direct the subcontractor and 
vendor mass property effort? 

(2) Is the contractor satisfied with the subcontractor’s 
mass properties group effort? 

(3) Does the subcontractor meet minimum discipline 
standards similar to those required of the contractor 
in item C of classifications 2 thru 5 and 7 thru 9 ? 
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d. Training and Education 

(1) Does the subcontractor meet minimum mass property 
training and education requirements similar to those 
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requirements of the contractor in item d. of classi- 
fications 2 thru 5, and 7 thru 9? 

e. Judgments 

(1) Does the subcontractor meet minimum judgment 
standards similar to those delineated in item e. 
of classifications 2 thru 5, and 7 thru 9? 

f. Technical 

(1) Does the subcontractor meet minimum technical 
standards similar to those delineated in item f. 
of classifications 2 thru 5, and 7 thru 9? 
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QUALITATIVE EVALUATION NO DATE 

CENTER. -CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 



Classification: 7, MEASURED DATA 


Objective : To establish the adequacy and quality of the 
contractor's mass measurement program. 


a. Planning 

(1) Does the contractor have a planned (i.e. , a key event 
and milestone schedule) mass properties measurement 
program ? 

(2) Does the plan provide for analyses to establish the 
requirements for measurements, for facility accuracy 
verification (i.e. , calibration and attendant error 
analyses), for mass measurement result documentation, 
subsequent data reduction, and final reporting? 



b. Communication 

(1) Does the contractor's mass property control group 
have cognizance over all mass measurements (i.e., in 
the sense of having prepared or concurred in measure- 
ment procedures and ultimately receiving the results of 
said measurements) ? 

(2) Are the results of said measurements transmitted to 
NASA as required by NASA SP-6004or its equivalent? 



c. Disciplines 

(1) Are procedures for the mass measurement of 
incoming equipment and contractor fabricated 
hardware strictly enforced ? (An affirmative 
answer requires a documented procedure which 
includes periodic quality control checks. ) 

(2) Is a NASA representative (at least an inspector) 
present when specification requirements are to 
be verified ? 



d. Training and Education 

(1) Are mass measurements performed by qualified 
personnel ? (An affirmative answer should be 
verified by a personnel checkout or training 
record. ) 
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e. 


Judgments 

(1) Has the contractor performed studies to support his 
judgments on which mass properties (including sub- 
assemblies equipment and total vehicle) require 
verification? 

(2) Has the contractor developed, acquired, and maintained 
mass measurement equipments and/or facilities that 
are consistent with the precisions, accuracies, and/or 
tolerances to which he is contractually obligated? 



f. Technical 

(1) Have facility accuracies been verified (i.e. , are ap- 
proved facility error analyses and calibration reports 
available) ? 

(2) Have all measurement procedures been approved by 
NASA in accordance with NASA SP -6004 or its equiva- 
lent? 
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QUALITATIVE EVALUATION NO DATE 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 


Classification: 8. MASS PROPERTIES AND PERFORMANCE ASSURANCE 


Objective : To determine if the contractor is exerting sufficient 
effort to design and fabricate vehicle stages and 
modules to meet or better specification mass 
property requirements. 


a. Planning 

(1) Does the contractor's mass property control plan 
provide for the establishment of procedures for 
detecting mass property weaknesses before they 
become critical ? (Refer to classification 4. 
item f. 3.) 

b. Communications 

(1) Are detected anomalies communicated directly to 
project management, cognizant engineering groups, 
and NASA representatives? 
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c. Disciplines 

(1) Does project management take prompt action in 

effecting trade-off and alternate design analysis when 
specific mass properties are shown to have a high 
probability of exceeding specification limits ? 


N 


d. Training and Education 

(1) Has the contractor provided sufficient evidence and 
knowledge of trade-off assessments which are 
predictive in nature ? 
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e. Judgments 

(1) Have the judgments made to date by the contractor in 
assuring the meeting or bettering of mass property 
and performance requirements been sound and timely? 
(This can be verified by examining actual measure- 
ment records and comparing them to target, control 
limit, or specification requirements.) 
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{. Technical 

(1) Has the contractor developed and applied analytic 
procedures and techniques to verify and optimize 
mass property and performance trade-offs? (An 
affirmative answer requires tangible evidence in 
the form of reports. ) 
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QUALITATIVE EVALUATION NO DATE 

CENTER CONTRACTOR 

CONTRACT NO STAGE/MODULE 

RATING OFFICIAL 

Name and Title 


Classification: 9. SUBMITTALS 


Objective : To determine the adequacy and timeliness of the 

contractor’s internal and external (NASA) mass 
property reporting system. 


a. Planning 

(1) Does the contractor’s submittal schedule conform to 
that of NASA SP-6004 or its equivalent? 

(2) Does the contractor disseminate internal status reports 
in accordance with a planned schedule ? 

(3) Are reports submitted to NASA on a vehicle serial 
number basis? 

b. Communication 

(1) Are the formats and functional codes of NASA SP-6004 
or its equivalent adhered to by the contractor ? 

(2) Are the internal reports furnished to the functional 
design groups of sufficient depth to assure immediate 
understanding of existing or predicted mass property 
problems? (They should include current status, 
trends, targets, control limits, and performance 
trade-off effects as appropriate.) 


a 

a 

a 

a 

InJ 

a 


+ 

y 

- 

+ 

N 

- 


a 

Y 

- 

+ 

N 

M 


+ 

a 

- 

+ 

N 

M 



a 

a 

a 

N 

a 


c. Disciplines 

(1) Has the contractor made a concentrated effort to meet 
scheduled submittal dates? (This can be verified by 
checking NASA dates of receipts.) 

(2) Is the internal reporting schedule reasonably adhered 
to? (This can be verified by reviewing the contractor's 
file copies of internal reports.) 


a 

a 
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+ N 

a 


a 

a 

a 

a 

N ! 
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d. Training and Education 

(1) Do the reports submitted to NASA and the contractor’s 
internal reports meet minimum professional standards? 
(Do they reflect an understanding of overall mass 
property control and governing requirements?) 


a 

a 

a 

a 
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a 
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e . Judgments 

(1) Do the reports submitted to NASA consistently reflect 
the design base to which they are referenced? (This 
can be verified by reviewing the contractor's qualifying 
statements and technical descriptions contained in 
said reports . ) 



Y 

□ 


H 
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f. Technical 

(1) Does the contractor provide detail mass property 
analyses as required by NASA SP-6004 or its equiva- 
lent? 


N 
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OBJECTIVES 

CLASSIFICATION 

1 PREPAREDNESS AND 
ATTITUDES 

2 FORMULATION OF 
REQUIREMENTS 

3 FORMULATION OF MASS 

PROPERTIES CONTROL SYSTEM 

4 MASS PROPERTIES ANALYSIS 

5 DESIGN MONITORING 

6 SUB- CONTRACTOR AND 
VENDOR SURVEILLANCE 

7 MEASURED DATA 

6 MASS PROPERTIES AND 
PERFORMANCE ASSURANCE 

9 SUBMITTALS 

I SUM 1 THRU 9 

E DIVIDE I BYE AND ENTER IN IE 

El ADMINISTRATIVE 
PROFICIENCY 
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TABLE m - FINAL REPORT - SAMPLE OUTLINE 


WEIGHT/PERFORMANCE MANAGEMENT SURVEY 
FINAL REPORT 


Date 


1. (a) Organization Surveyed: 


(b) C ontract No . : 

(c) Surveyed By: __ 

(d) Date of Survey: 

2. CONCLUSIONS: 

(a) through (i) - Paragraphs summarizing results of survey for each of the nine 
classifications, with particular emphasis on problem areas. 

(EXAMPLE) 

(f) Subcontractor and Vendor Surveillance: A critical problem exists, as evidenced 
by the exceeding of maximum weight specifications, on 47% of the items delivered to 
date. Such failure to meet specification requirements involves more than one-third 
of all subcontractors who have weight specifications to meet. Apparent causes are: 

(1) Failure by contractor to require Weight/Performance Management Program on 
the part of subcontractors . 

(2) Failure to exercise detailed monitoring of subcontractor design activities. 

3 . RECOMMENDATIONS 

Recommendations for improvement of contractor's Weight/Performance Management 
Program, and directives for actions to resolve critical problem areas. 

(EXAMPLE) 

(g) Submit evidence within sixty days that adequate Weight/Performance Management 
requirements have been imposed on all subcontractors. 

(h) Submit within 30 days plans for regular, detailed, quantitative, monitoring of 
subcontractor Weight activities . 

4 . SUR VE Y DISC USSION 

(a) General discussion of critical survey results. 

(b) Contractor cooperation in survey. 
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(c) Adequacy of contractor preparation for survey. 

(d) Consistency between verbal answers and substantiating evidence. 

(e) Contractor innovations in Weight/Performance Management, and areas of out- 
standing performance. (These may be applicable to improving the performance of 
other contractors.) 

5. ATTACHMENTS 

Detailed results and data to substantiate, clarify, or expand on items covered in the 
report. 


NASA -Langley, 1965 
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